Focused Crawls

Internet Archive

Focused crawls are collections of frequently-updated webcrawl data from narrow (as opposed to broad or wide) web crawls, often focused on a single domain or subdomain.

More...

RSS

ABOUT

COLLECTION

SHOW DETAILS

SORT BY

VIEWS

TITLE

DATE ARCHIVED

CREATOR

3.9B 3.9B

Top Domains

351,614

ITEMS

3.9B

VIEWS

Nov 29, 2011 11/11

eye 3.9B

A daily collection of thousands of the most popular web sites according to Alexa.com's top sites rankings .
Topics: daily, popular sites, Alexa

1.7B 1.7B

eye 1.7B

A daily collection of hundreds of the world's top news sites.
Topics: daily, news

114.3M 114M

top_domains-00300

9,437

ITEMS

114.3M

VIEWS

Nov 15, 2013 11/13

by Internet Archive

eye 114.3M

125.3M 125M

top_domains-00500

18,584

ITEMS

125.3M

VIEWS

Nov 15, 2013 11/13

by Internet Archive

eye 125.3M

112.1M 112M

top_domains-00900

5,487

ITEMS

112.1M

VIEWS

Nov 15, 2013 11/13

by Internet Archive

eye 112.1M

86.1M 86M

top_domains-00800

14,941

ITEMS

86.1M

VIEWS

Nov 15, 2013 11/13

by Internet Archive

eye 86.1M

84.3M 84M

top_domains-00350

3,343

ITEMS

84.3M

VIEWS

Nov 15, 2013 11/13

by Internet Archive

eye 84.3M

62.8M 63M

nytimes.com

2,947

ITEMS

62.8M

VIEWS

Nov 1, 2011 11/11

by http://nytimes.com

68.2M 68M

yahoo.com

2,890

ITEMS

68.2M

VIEWS

Feb 14, 2014 02/14

eye 68.2M

67.7M 68M

top_domains-00450

3,864

ITEMS

67.7M

VIEWS

Nov 15, 2013 11/13

by Internet Archive

eye 67.7M

47.4M 47M

top_domains-06000

4,847

ITEMS

47.4M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 47.4M

69M 69M

top_domains-00700

1,974

ITEMS

69M

VIEWS

Nov 15, 2013 11/13

by Internet Archive

eye 69M

47M 47M

top_domains-03500

2,598

ITEMS

47M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 47M

42.7M 43M

foxnews.com

2,205

ITEMS

42.7M

VIEWS

Sep 22, 2011 09/11

by http://foxnews.com

eye 42.7M

63.3M 63M

top_domains-02750

3,199

ITEMS

63.3M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 63.3M

61.7M 62M

top_domains-07500

3,504

ITEMS

61.7M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 61.7M

50.5M 50M

top_domains-03000

2,820

ITEMS

50.5M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 50.5M

38.3M 38M

welt.de

3,453

ITEMS

38.3M

VIEWS

Nov 23, 2011 11/11

by http://welt.de/

eye 38.3M

49.7M 50M

top_domains-08000

2,433

ITEMS

49.7M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 49.7M

49.7M 50M

top_domains-04500

3,560

ITEMS

49.7M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 49.7M

58.2M 58M

top_domains-02250

3,420

ITEMS

58.2M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 58.2M

34.7M 35M

msnbc.msn.com

15,758

ITEMS

34.7M

VIEWS

Nov 1, 2011 11/11

by http://msnbc.msn.com/

eye 34.7M

51.7M 52M

top_domains-09500

4,891

ITEMS

51.7M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 51.7M

47.2M 47M

top_domains-04250

3,236

ITEMS

47.2M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 47.2M

44M 44M

top_domains-09000

3,877

ITEMS

44M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 44M

48.9M 49M

top_domains-04000

3,601

ITEMS

48.9M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 48.9M

45.9M 46M

taringa.net

1,406

ITEMS

45.9M

VIEWS

Nov 15, 2013 11/13

by taringa.net

eye 45.9M

37.7M 38M

top_domains-01250

2,182

ITEMS

37.7M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 37.7M

40.8M 41M

top_domains-03750

2,558

ITEMS

40.8M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 40.8M

51.3M 51M

top_domains-01000

5,363

ITEMS

51.3M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 51.3M

45M 45M

time.com

894

ITEMS

45M

VIEWS

Sep 22, 2011 09/11

by http://time.com

eye 45M

46.4M 46M

top_domains-08750

3,526

ITEMS

46.4M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 46.4M

41.5M 42M

top_domains-04750

3,237

ITEMS

41.5M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 41.5M

40.2M 40M

top_domains-05250

6,013

ITEMS

40.2M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 40.2M

39.9M 40M

top_domains-05500

8,528

ITEMS

39.9M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 39.9M

57.2M 57M

worldpress.org

674

ITEMS

57.2M

VIEWS

Nov 23, 2011 11/11

by http://worldpress.org/

eye 57.2M

28.1M 28M

abcnews.go.com

2,803

ITEMS

28.1M

VIEWS

Oct 5, 2011 10/11

by http://abcnews.go.com/

eye 28.1M

38.8M 39M

top_domains-03250

1,833

ITEMS

38.8M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 38.8M

18.4M 18M

theweek.com

1,892

ITEMS

18.4M

VIEWS

Oct 5, 2011 10/11

by http://theweek.com

eye 18.4M

34.3M 34M

top_domains-05750

1,919

ITEMS

34.3M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 34.3M

27.5M 27M

blogspot.in

1,411

ITEMS

27.5M

VIEWS

Nov 15, 2013 11/13

by blogspot.in

eye 27.5M

41.3M 41M

top_domains-01750

1,710

ITEMS

41.3M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 41.3M

36.5M 36M

top_domains-08250

4,115

ITEMS

36.5M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 36.5M

39.6M 40M

top_domains-06250

2,511

ITEMS

39.6M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 39.6M

36.1M 36M

top_domains-06500

3,071

ITEMS

36.1M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 36.1M

39.7M 40M

top_domains-06750

3,635

ITEMS

39.7M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 39.7M

32.9M 33M

sfgate.com

3,634

ITEMS

32.9M

VIEWS

Sep 22, 2011 09/11

by http://sfgate.com

eye 32.9M

23.4M 23M

weather.com

1,329

ITEMS

23.4M

VIEWS

Nov 23, 2011 11/11

by http://weather.com/

eye 23.4M

31M 31M

latimes.com

1,063

ITEMS

31M

VIEWS

Sep 22, 2011 09/11

by http://latimes.com

eye 31M

18.1M 18M

bild.de

7,481

ITEMS

18.1M

VIEWS

Oct 5, 2011 10/11

by http://bild.de/

eye 18.1M

28.4M 28M

top_domains-07250

2,648

ITEMS

28.4M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 28.4M

37.8M 38M

huffingtonpost.com

12,583

ITEMS

37.8M

VIEWS

Nov 28, 2011 11/11

by http://huffingtonpost.com

eye 37.8M

21.3M 21M

reuters.com

1,140

ITEMS

21.3M

VIEWS

Sep 22, 2011 09/11

by http://reuters.com

eye 21.3M

30.2M 30M

top_domains-05000

1,489

ITEMS

30.2M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 30.2M

45.8M 46M

top_domains-07750

1,715

ITEMS

45.8M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 45.8M

28.6M 29M

top_domains-08500

1,616

ITEMS

28.6M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 28.6M

15.3M 15M

abc.net.au-news

2,018

ITEMS

15.3M

VIEWS

Sep 22, 2011 09/11

by http://abc.net.au/news/

eye 15.3M

27.1M 27M

chicagotribune.com

633

ITEMS

27.1M

VIEWS

Oct 5, 2011 10/11

by http://chicagotribune.com/

eye 27.1M

35.5M 35M

top_domains-07000

2,678

ITEMS

35.5M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 35.5M

42.1M 42M

themeforest.net

744

ITEMS

42.1M

VIEWS

Nov 15, 2013 11/13

by themeforest.net

eye 42.1M

23.4M 23M

bbc.co.uk

1,102

ITEMS

23.4M

VIEWS

Sep 22, 2011 09/11

by http://bbc.co.uk

eye 23.4M

19.6M 20M

edition.cnn.com

1,185

ITEMS

19.6M

VIEWS

Oct 5, 2011 10/11

by http://edition.cnn.com/

eye 19.6M

13.1M 13M

fbdailycrawl.io

10,227

ITEMS

13.1M

VIEWS

Dec 20, 2018 12/18

by Internet Archive

eye 13.1M

22.4M 22M

cnn.com

1,512

ITEMS

22.4M

VIEWS

Sep 22, 2011 09/11

by http://cnn.com

eye 22.4M

25.4M 25M

top_domains-09750

1,882

ITEMS

25.4M

VIEWS

Jan 22, 2014 01/14

by Internet Archive

eye 25.4M

28.3M 28M

inn.co.il

3,307

ITEMS

28.3M

VIEWS

Nov 1, 2011 11/11

by http://inn.co.il/

eye 28.3M

MORE RESULTS
Fetching more results

DESCRIPTION

Focused crawls are collections of frequently-updated webcrawl data from narrow (as opposed to broad or wide) web crawls, often focused on a single domain or subdomain.

ACTIVITY

comment

Collection Info

Access-restricted: true

Addeddate: 2011-11-04 21:23:48

Collection: web

Creator: Internet Archive

Identifier: focused_crawls

Identifier-ark: ark:/13960/t0vq3z00h

Mediatype: collection

Public-format: Metadata
Collection Header
JPEG
JPEG Thumb
PNG
Animated GIF
Item Tile

Publicdate: 2011-11-04 21:24:06

Storage_size: 4.3 PB (in 28,776,416 files)

Subject: webcrawl

Title: Focused Crawls

Created on

November 4
2011

Aaron Ximm
Archivist

VIEWS

Total Views 6,119,662,076 (Older Stats)

ITEMS

Total Items 705,334 (Older Stats)

TOP REGIONS (LAST 30 DAYS)

(data not available)

Internet Archive Audio

Featured

Top

Images

Featured

Top

Software

Featured

Top

Books

Featured

Top

Video

Featured

Top

Mobile Apps

Browser Extensions

Archive-It Subscription

Save Page Now

Focused Crawls

Internet Archive

Filters 705,258 RESULTS

Media TypeMedia Type

YearYear

Topics & SubjectsTopics & Subjects

CollectionCollection

CreatorCreator

LanguageLanguage

eye 3.9B

eye 1.7B

eye 114.3M

eye 125.3M

eye 112.1M

eye 86.1M

eye 84.3M

eye 62.8M

eye 56.9M

eye 105.7M

eye 69.2M

eye 74.6M

eye 85.9M

eye 49.7M

eye 80.5M

eye 56.4M

eye 62.6M

eye 68.2M

eye 67.7M

eye 47.4M

eye 69M

eye 47M

eye 42.7M

eye 63.3M

eye 61.7M

eye 50.5M

eye 38.3M

eye 49.7M

eye 49.7M

eye 58.2M

eye 34.7M

eye 51.7M

eye 47.2M

eye 44M

eye 48.9M

eye 45.9M

eye 37.7M

eye 40.8M

eye 51.3M

eye 45M

eye 46.4M

eye 41.5M

eye 40.2M

eye 39.9M

eye 57.2M

eye 28.1M

eye 38.8M

eye 18.4M

eye 34.3M

eye 27.5M

eye 41.3M

eye 36.5M

705,258
RESULTS

Media Type

Year

Topics & Subjects

Collection

Creator

Language